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FIELD OF THE INVENTION 
[0001] The present invention relates generally to an image capturing device, 
and more particularly to an image capturing device capable of capturing an image at 
multiple focus depths. 

BACKGROUND OF THE INVENTION 
[0002] Still image capturing devices are used to visually memorialize scenes, 
events, or items. Still image capturing devices, such as analog and digital cameras, 
include a lens, a shutter, and some manner of image sensor. In addition, most 
modern cameras include a processor and/or other control electronics that function to 
control shutter speed, aperture, flash, focus, etc. 

[0003] The shutter and the image sensor are the main components of a still 
image capturing device and operate together in order to produce an image. In 
operation, the shutter is opened briefly to expose the image sensor to focused light 
from a lens and thereby form an image. The operation of the shutter is very 
important, and the quality of the captured image depends on a proper exposure time 
based on lighting, movement of the subject, focus distance, etc. 
[0004] A prior art shutter approach used a mechanical shutter. The mechanical 
shutter has been widely used for a number of years and is generally in the form of 
an iris-type shutter. However, the prior art mechanical shutter has many drawbacks, 
including weight, large size, susceptibility to dirt and wear, and the difficulty of 
precisely controlling shutter exposure times over a wide range of conditions. In 
addition, the mechanical shutter exposes the entire image as a unit and essentially 
at once (however, the iris mechanism is open at the center for a longer length of 
time than at the peripheral region of the iris). 
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[0005] In some prior art cameras, the mechanical shutter is electronically 
activated by a motor or other electrical actuator. This may produce a more accurate 
shutter control, but consumes a lot of electrical power, is inflexible, and still exposes 
the entire image as a unit and for an essentially constant duration. 
[0006] The prior art therefore cannot control a focus depth of an image in order 
to capture image portions or objects at different focus depths. For example, in an 
image of a person in front of a background, prior art image capturing devices focus 
to the person, and the entire image is captured at that single focus depth. As a 
result, the background is out of focus. An image captured according to the prior art 
therefore may have portions that are in focus and may have portions that are out of 
focus. 

[0007] Therefore, there remains a need in the art for improvements in still 
image capturing devices. 

SUMMARY OF THE INVENTION 
[0008] A still image capturing device includes a focusable lens apparatus 
capable of being focused over a range of focus depths, an image sensor comprising 
a plurality of pixel elements, and an electronically actuatable shutter device 
comprising a plurality of individually addressable and actuatable shutter elements. A 
shutter element substantially corresponds to one or more pixel elements. A 
processor controls a focus depth of the lens apparatus and selectively actuates 
particular shutter elements associated with each of a plurality of focus depths during 
image capture. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0009] FIG. 1 is a block diagram of a still image capturing device according to 
one embodiment of the invention; 

[0010] FIG. 2 shows detail of the shutter array and an electronic image sensor; 
[0011] FIG. 3 is a flowchart of an image capturing method according to one 
embodiment of the invention; and 

[0012] FIG. 4 is a flowchart of an image capturing method according to another 
embodiment of the invention. 

DETAILED DESCRIPTION 
[0013] FIG. 1 is a block diagram of a still image capturing device 100 according 
to one embodiment of the invention. The image capturing device 100 includes a 
lens apparatus 102, a processor 106, a shutter array 114, an image sensor 117, a 
shutter button 118, and a memory 120. The shutter array 114 and the image sensor 
117 may be provided as an imaging module 110. In addition, the image capturing 
device 100 includes a user interface 138. 

[0014] The shutter array 1 14 is electronically actuated and comprises a two 
dimensional array of individually addressable shutter elements (see FIG. 2 and 
accompanying discussion). The shutter array 1 14 is preferably a liquid crystal 
display (LCD) element comprising a two-dimensional array of individually 
addressable and actuatable shutter elements. Alternatively, the shutter array 114 
may be a switchable reflecting device, such as a microelectromechanical device 
comprising a two-dimensional array of electrically addressable and actuatable 
mechanical shutter sub-elements. 
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[0015] The image sensor 117 may comprise an electronic image sensor or 
conventional film. The film may comprise a plurality of pixel elements (i.e., picture 
elements) to be exposed. Preferably, the image sensor 117 comprises a CCD array 
or a CMOS array, for example, and is formed of a two-dimensional array of pixel 
elements. The pixel elements receive light through the shutter array 1 14 and 
generate electronic signals related to the amount of light received. 
[0016] The processor 1 06 may be any type of general purpose processor and 
may control the overall operation of the image capturing device 100. The processor 
106 receives input signals from the shutter button 118 and the user interface 138 
and controls a shuttering operation of the shutter array 1 14 in order to capture an 
image. In addition, if the image sensor 1 17 is an electronic device, the processor 
106 controls the storage of digital image data produced by the image sensor 117. 
For example, the processor 106 may receive images and store them in the memory 
120. Alternatively, the processor 106 may control camera operation in order to 
capture an image on film. In addition, the processor 106 receives user input signals 
and performs functions specified by the user input signals. 
[0017] The focus rangefinder 1 23 may be any type of device capable of 
measuring a distance from the image capturing device 100 to a subject. The focus 
rangefinder 123 may be an ultrasound or infrared distance measuring device, for 
example, or alternatively may employ radio waves. The focus rangefinder 123 may 
provide one or more range measurements to the processor 106, and optionally may 
be able to obtain a plurality of range measurements over an area to be captured 
during an image capture process. 

[0018] Alternatively, the range measurements may be generated by the 
processor 106 if the image sensor 1 17 is an electronic device such as a CCD or 

-5- 



PDNO 10011707-1 



CMOS array, for example. This is the most commonly used method in both digital 
and film image capturing devices. In this embodiment, all shutter elements 204 of 
the shutter array 114 (see FIG. 2) may be momentarily opened such that the 
processor 106 receives an image comprising a two-dimensional array of pixel values 
{i.e., a pre-exposure). The processor 106 may use an image analysis algorithm to 
find edges in the resultant image and determine whether the edges are focused by 
determining whether the edges are sharply defined. Furthermore, by changing the 
focus depth of the lens apparatus 102 and performing repeated image capture and 
image analysis steps, the processor 106 may determine all focus depths of objects 
or regions in the image. 

[0019] The user interface 138 may include a display device and a user input 
device. The display device may be any type of electronic display device, such as an 
LCD screen, for example. The user input device may comprise one or more buttons. 
The one or more buttons may be used in conjunction with a displayed menu or 
other selection display, and a user may manipulate the buttons in order to make 
selections. Alternatively, the user interface 138 may comprise a touch screen 
wherein the user may touch displayed icons, symbols, etc., in order to make 
selections and to control operation of the image capturing device 100. 
[0020] In operation, the shutter array 1 14 is controlled by the processor 1 06 in 
response to a press of the shutter button 1 1 8. Incoming light enters the image 
capturing device 100 through the lens apparatus 102 and impinges upon the shutter 
array 114. When activated by the processor 106, the shutter array 114 allows the 
incoming light to pass through, i.e., the shutter array 1 14 transforms from a light 
reflective or opaque state to a light transmissive state. The shutter array 1 14 is 
controlled to be light transmissive for a predetermined exposure period, and is 
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controlled to become light opaque or reflective at the end of the predetermined 
exposure period. Therefore, when the light passes through the shutter array 1 14 
and impinges on the image sensor 117, an image may be captured by the image 
sensor 117. 

[0021] The memory 1 20 may be any type of memory, including all types of 
random access memory (RAM), read-only memory (ROM), flash memory, magnetic 
storage media such as magnetic disc, tape, etc., or optical or bubble memory. In a 
digital image capturing device, the memory 120 may include, among other things, an 
image storage cell 131, an optional objects storage cell 141, an image map storage 
cell 162, and an optional range storage cell 167. In addition, the memory 120 may 
store software or firmware to be executed by the processor 106. 
[0022] The image storage cell 131 may store one or more complete images. In 
addition, it may store image portions obtained during an image capture, such as the 
image portions 1 and 2 shown. The image portions may be successively captured at 
different focus depths in order to capture an image that is substantially in focus over 
its entire area. The image portions may be captured by successively focusing the 
lens apparatus 1 02 at various focus depths and exposing distinct regions of the 
image sensor 117, as defined by the image map 162. 

[0023] The image map storage cell 162 may store one or more image maps 
that relate an object or focus depth to a particular grouping of shutter elements 204. 
Therefore, each image map stored in the image map storage cell 162 controls 
actuation of a predetermined grouping of shutter elements 204. By employing 
multiple image maps, an image capture may be conducted by successively opening 
each grouping of shutter elements, in conjunction with moving the lens apparatus 
102 to achieve each corresponding focus depth. 
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[0024] The objects storage cell 141 is optional and may store definitions of one 
or more objects to be included in an image capture. The object definitions are 
generally temporary in nature and may only need to be stored until the associated 
image capture has been completed. The objects may be defined by focus depth 
measurements, by boundaries entered by the user, or may be one of several 
predetermined, stored shapes selected by the user. 

[0025] The range storage cell 1 67 may store one or more focus depth range 
measurements. The range measurements are generally temporary in nature and 
may only need to be stored until the associated image capture has been completed. 
The range measurements are generated by the focus rangefinder 123 and may be 
used to capture individual image portions in order to create an image composed of a 
plurality of image portions. 

[0026] FIG. 2 shows detail of the shutter array 114 and an electronic image 
sensor 1 17. A two-dimensional array of shutter elements 204 is formed on or 
assembled to a two-dimensional array of image sensor pixel elements 207. 
Therefore, in one embodiment a shutter element 204 may correspond substantially 
in size to a pixel element 207. Alternatively, in another embodiment the shutter 
element 204 may correspond in size to two or more pixel elements 207, allowing a 
shutter element 204 to shutter two or more pixel elements 207. Furthermore, the 
shutter array 1 14 is arranged so that the shutter elements 204 are substantially 
aligned with one or more corresponding pixel elements 207, and may operate to 
block or transmit light to the one or more corresponding pixel elements 207. 
[0027] As previously discussed, the shutter array 114 may comprise an LCD 
element formed of a two-dimensional array of individually addressable and 
actuatable shutter elements. Therefore, the processor 106 may actuate one or more 
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shutter elements 204, may actuate a pattern of shutter elements 204, or may 
actuate shutter elements 204 for differing periods of time. The shutter elements 204 
may be actuated in any combination, and may be actuated according to a pattern or 
timetable. Therefore, the imaging module 1 10 according to the invention is capable 
of performing a pixel-by-pixel shuttering. The invention may expose small regions, 
even individual pixel elements, because the shutter array 114 may be formed on the 
electronic image sensor 117. As a result, the shutter array 1 14 may control 
exposure of the pixel elements 207 without any significant shuttering overlap, light 
leakage, loss of focus, etc. 

[0028] In one embodiment, the LCD element is a polymer dispersed liquid 
crystal (PDLC) element. The PDLC element may be used without polarizing films. 
The PDLC element may be used regardless of the polarization effect, or alternatively 
a PDLC shutter array 1 14 may be formed of shutter elements possessing different 
polarization orientations in order to pass substantially non-polarized light, as 
discussed below. 

[0029] In another embodiment, the LCD element is a nematic or super-twisted 
nematic LCD. In these types of LCD, both sides of the LCD element include a 
polarizing film. Therefore, the image capture employs polarized light. The polarizing 
single LCD element configuration is the simplest and cheapest, and provides the 
best "dark" state and may therefore still be preferable even though light is lost by 
having to pass through polarizing films. 

[0030] The polarizing effect may be negated, however. In this embodiment, a 
pixel unit 222 may comprise a pair of shutter elements 204 and a pair of pixel 
elements 207. The paired pixel element configuration of the pixel unit 222 is 
desirable because of the polarization. Therefore, a pixel unit 222 according to the 
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invention may include a shutter element of a first polarization orientation and a 
shutter element of a second polarization orientation. The second polarization 
orientation is substantially orthogonal to the first polarization orientation. As a result, 
the two pixel element polarizations are combined to capture substantially non- 
polarized light, and therefore the imaging module 1 10 as a unit may capture a 
substantially non-polarized image. 

[0031] The polarizing film in this embodiment may be formed of narrow bands 
of polarizing material, with each pixel element of a pixel unit 222 being from a 
separate polarization band (the pixel elements may be separated by a small 
distance). The bands may be formed having substantially perpendicular polarization 
orientations. Alternatively, each shutter element 204 may have a corresponding 
polarizing element that is deposited on or otherwise formed on the LCD element. 
[0032] The above non-polarizing shutter may alternatively be implemented 
using two LCD elements, a beam splitter, and a beam combiner. The beam splitter 
splits the incoming light into two light beams and each beam is separately directed 
into one of the two LCD shutters. In this embodiment, the two LCD shutters polarize 
the light, and the two LCD shutters are positioned in substantially perpendicular 
polarization orientations. The polarized light from each shutter is then directed into 
the beam combiner, wherein the two substantially perpendicular polarized light 
beams are combined to form a substantially non-polarized resultant light beam. 
[0033] In an alternate embodiment, the shutter array 114 may comprise a two- 
dimensional array of individually addressable and actuatable reflective 
micromechanical shutter (MEMS) elements, as is known in the art. The 
microelectromechanical elements may be actuated by an electric current. Unlike the 
prior art, however, the microelectromechanical elements are used as a reflective 
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shutter. The MEMS device comprises actuatable mirrors that can reflect light 
straight out from the array or scatter it. As before, the actuation of the 
micromechanical elements is controlled by the processor 106 and may be controlled 
and actuated to selectively expose regions of the electronic image sensor 117. 
[0034] FIG. 3 is a flowchart 300 of an image capturing method according to one 
embodiment of the invention. In step 301, an image capture is initiated. This is 
generally done at a press of the shutter button 1 1 8. 

[0035] In step 303, the image capturing device 100 performs a first focus depth 
measurement. This may be done using the focus rangefinder 123 or using the 
image analysis, for example. The first focus depth measurement may be a distance 
to a subject of the image capture, such as a measurement of a distance to an object 
centered in a viewfinder of the image capturing device 100. The image capturing 
device 100 therefore generates a two-dimensional array of focus depth 
measurements (i.e., an image map). 

[0036] In step 304, the lens apparatus 1 02 is moved to focus at the first focus 
depth. 

[0037] In step 306, a first image portion is captured at the first focus depth, 
corresponding to a first subset of the plurality of picture elements. The first image 
portion may be, for example, an object or item within cross hairs or designated 
region of the camera's field of view, for example. The first image portion is captured 
by opening and closing only those shutter elements 204 corresponding to the 
designated region at a first focus depth. The image capture therefore comprises 
exposing a portion of film or a portion of the electronic image sensor 1 1 7. For 
example, the first image portion may expose all pixel outputs corresponding to a 
focus depth of four to six feet. 
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[0038] in an optional step 309, the image capturing device 100 performs a 
second focus depth measurement. This may be done by the user moving a cross- 
hairs or pointer to another region and initiating a second focus measurement. A 
user may therefore designate multiple focus regions. Alternatively, the second focus 
depth may be a default, such as an infinite or maximum focus depth (i.e., the first 
focus depth is the distance to a subject and the second focus depth captures a 
background). 

[0039] In step 31 1 , the lens apparatus 102 is moved to focus at the second 
focus depth. 

[0040] In step 31 5, a second image portion is captured at the second focus 
depth, corresponding to a second subset of the plurality of picture elements. The 
second image portion is captured by opening and closing only those shutter 
elements 204 corresponding to the designated region at a second focus depth. 
[0041] It should be understood that more than two image portions may be 
captured. Only two are shown and discussed in order to illustrate the concept of the 
invention, i.e., that by using a shutter array 1 14 comprising a plurality of shutter 
elements 204, the image capturing device 100 may capture portions of an image at 
different focal depths. Therefore, the image capturing device 100 according to the 
invention may perform iterative steps of measuring focal depths, moving the lens 
apparatus 102, and capturing successive image portions in order to capture a 
complete image that is substantially focused over an entire image area. 
[0042] The above described method also may be employed in a camera using 
conventional film. Alternatively, the method may be employed in an image capturing 
device 100 that employs a CMOS image sensor 117. The CMOS image sensor 117 
is capable of capturing partial images. Alternatively, a CCD image sensor 117 may 
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be used, but cannot capture and output a partial image. However, the image 
capturing device 100 does not have to accept or store all image output from the 
image sensor 117. Therefore, in a CCD image sensor embodiment, either partial 
images may be saved to memory or multiple images may be captured and combined 
in memory in order to form a resultant image that was captured at multiple focus 
depths. 

[0043] FIG. 4 is a flowchart 400 of an image capturing method according to 
another embodiment of the invention. In step 402, object designations are accepted 
by the image capturing device 100. The object designations may be input by a user. 
If input by the user, the designations may be generated by employing object 
selection indicia. The object selection indicia may be a cross-hairs or pointer that 
may be moved in a display, such as a display of the user interface 138. Therefore, 
the user may be able to designate an object by pressing a select button or mode 
button when the cross-hairs or pointer is positioned on the object in the display. 
Alternatively, the user may select objects or regions of interest. For example, the 
user may be able to create a box or shape surrounding an object. Alternatively, an 
object or objects may be automatically generated by the processor 1 06 using image 
analysis (i.e., by detecting edges, for example). 

[0044] Alternatively, if the image capturing device 100 automatically generates 
object designations, this may be done by measuring focus depths and grouping 
areas of substantially similar focus depths as being objects. 
[0045] In step 406, the image capture is initiated, as previously discussed. 
[0046] In step 41 1 , a first object is captured by exposing a first subset of the 
pixel elements. The first object may be at a first focus depth. 
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[0047] In step 414, a second object image may be captured by exposing a 
second subset of the pixel elements. The second object may optionally be at a 
second focus depth, although it may be at approximately at the same focus depth as 
other objects in the image capture. The second object image is distinct from the first 
object and may appear in a different part of the image. 
[0048] It should be understood that the method 400 may be iteratively 
performed and may be done for more than two objects. Therefore, according to the 
method, the image capturing device 100 or the user may designate multiple objects, 
the lens apparatus 102 may be moved accordingly, and corresponding groupings of 
shutter elements 204 may be opened and closed to capture an image composed of 
multiple objects and therefore of multiple image portions. 

[0049] The image capturing device and methods discussed above have several 
advantages. The image capturing process may be more finely controlled and the 
image capture may be conducted at multiple focus depths in order to achieve an 
image that is substantially focused throughout. Moreover, the user has more control 
of the focus of the image capturing device, and can capture images wherein objects 
are at different focus depths. 
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